On Parametric and Implicit Algebraic Descriptions of Maximum Entropy Models
نویسندگان
چکیده
Main aim of this paper is to present some notions on how results from commutative algebra and algebraic geometry could be used in representation and computation of maximum and minimum entropy (ME) models. We show that various formulations of estimation of ME models can be transformed to solving systems of polynomial equations in cases where an integer valued sufficient statistic exists. We give an implicit description of ME-models by embedding them in algebraic varieties for which we give a Gröbner bases method to compute it.
منابع مشابه
A Note on the Bivariate Maximum Entropy Modeling
Let X=(X1 ,X2 ) be a continuous random vector. Under the assumption that the marginal distributions of X1 and X2 are given, we develop models for vector X when there is partial information about the dependence structure between X1 and X2. The models which are obtained based on well-known Principle of Maximum Entropy are called the maximum entropy (ME) mo...
متن کاملTsallis Maximum Entropy Lorenz Curves
In this paper, at first we derive a family of maximum Tsallis entropy distributions under optional side conditions on the mean income and the Gini index. Furthermore, corresponding with these distributions a family of Lorenz curves compatible with the optional side conditions is generated. Meanwhile, we show that our results reduce to Shannon entropy as $beta$ tends to one. Finally, by using ac...
متن کاملSome properties of the parametric relative operator entropy
The notion of entropy was introduced by Clausius in 1850, and some of the main steps towards the consolidation of the concept were taken by Boltzmann and Gibbs. Since then several extensions and reformulations have been developed in various disciplines with motivations and applications in different subjects, such as statistical mechanics, information theory, and dynamical systems. Fujii and Kam...
متن کاملDiscrete-velocity models and numerical schemes for the Boltzmann-BGK equation in plane and axisymmetric geometries
We present new numerical models for computing transitional or rarefied gas flows as described by the Boltzmann-BGK and BGK-ES equations. We first propose a new discrete-velocity model, based on the entropy minimization principle. This model satisfies the conservation laws and the entropy dissipation. Moreover, the problem of conservation and entropy for axisymmetric flows is investigated. We fi...
متن کاملMaximum Entropy in the framework of Algebraic Statistics: A First Step
Algebraic statistics is a recently evolving field, where one would treat statistical models as algebraic objects and thereby use tools from computational commutative algebra and algebraic geometry in the analysis and computation of statistical models. In this approach, calculation of parameters of statistical models amounts to solving set of polynomial equations in several variables, for which ...
متن کامل